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Mean and Correlation Functions 


10.1.2 Mean and Correlation Functions 

Since random processes are collections of random variables, you already possess the theoretical knowledge necessary to analyze random 
processes. From now on, we would like to discuss methods and tools that are useful in studying random processes. Remember that expectation 
and variance were among the important statistics that we considered for random variables. Here, we would like to extend those concepts to 
random processes. 

Mean Function of a Random Process: 


Mean Function of a Random Process 


For a random process {X(t), 16/}, the mean function Hjft) :«/ —► R, is defined as 

/*x(0 = E [ x (t)\ 

The above definition is valid for both continuous-time and discrete-time random processes. In particular, if {X n , n E j} is a discrete-time 
random process, then 

Hx(n) = E[X n ], for all n E J. 

Some books show the mean function by m^t) or Here, we chose to avoid confusion with moment generating functions. The mean 
function gives us an idea about how the random process behaves on average as time evolves. For example, if X(t) is the temperature in a certain 
city, the mean function fi^t) might look like the function shown in Figure 10.3. As we see, the expected value of X{t) is lowest in the winter 
and highest in summer. 
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Figure 10.3 - The mean function, for the temperature in a certain city. 


Example 10.4 

Find the mean functions for the random processes given in Examples 10.1 and 10.2 . 


Solution 

o For { X n , n = 0, 1, 2, •••} given in Example 10.1. we have 


Myi") = E[X^ 

= 1000£[y"] (where 7 = 1 + S ~ Uniform^ 1.04,1.05)) 
= looojl o^lOOv" dv (by LOTUS) 


fl + lf J 1( 

y[( 1.05)' , + 1 -(1.04)" +1 j, for all n £ {0, 1,2,-}. 


1.05 

1.04 


10 5 
n + 


For {X(t), t £ [0, oo) i given in Example 10.2 . we have 
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Mjff) = E[X{0] 

= E[A + Bt] 

= E[A\ + E[B]t 
= 1 + t, for all t 6 [0, go). 


Autocorrelation and Autocovariance: 

The mean function fi^t) gives us the expected value ofX(f) at time t, but it does not give us any information about howX(fj) and X{t^) are 
related. To get some insight on the relation between X(^) and X(? 2 ), we define correlation and covariance functions. 

For a random process fX(/), t E J J, the autocorrelation function or, simply, the correlation function, Rj^t\, t 2 ), is defined by 

R^t v t 2 ) — E[X{t^)X{t^)\, for fj, t 2 E J. 


For a random process {X{t), t E j\ , the autocovariance function or, simply, the covariance function, t 2 ), is defined by 

* 2 ) = Cov (X{t ^), X(^ 2 )) 

= R^t^, t 2 ) — for tp t 2 E J. 

Note that if we let f j = t 2 ~ t, we obtain 

R^t,t)=E[X(t)X(t)\ 

= E[X(t) 2 ], for t E J; 

Crft, t) = Cov(X(0,X(0) 

= Var(X(f)), for t E J. 

If ^ t 2 , then the covariance function C^(/j, t 2 ) gives us some information about howX(^) andX(? 2 ) are statistically related. In particular, 
note that 


C/t v t 2 ) = E^td-ElXit^X^-ElX^}. 

Intuitively, C^t j, ? 2 ) shows howX(^) and X(? 2 ) move relative to each other. If large values ofX(/j) tend to imply large values ofX(? 2 ), then 
(X{t^) — E[X(ti)]^(X(t 2 ) - £[X(f 2 )]) is positive on average. In this case, C^t l5 1 2 ) is positive, and we sayX(/j) andX(/ 2 ) are positively 
correlated. On the other hand, if large values ofX(7j) imply small values ofX(/ 2 ), then (X(^) — is [X(^)] )(X(f 2 ) — is [X(? 2 )] ) is negative on 
average, and we say X{t^) and X(/ 2 ) are negatively correlated. If C^j, t 2 ) = 0, then X(?j) and X(r 2 ) are uncorrelated. 


Example 10.5 

Find the correlation functions and covariance functions for the random processes given in Examples 10.1 and 10.2 . 
• Solution 

o For { X n , n = 0, 1,2, •••} given in Example 10.1. we have 


Rj(m,n)=E[X m X n \ 

= 10 6 E[r n Y n ] (where 7= 1 +R ~ Uniform^ 1.04, 1.05)) 
= 10 6 jj'“l00y< m+ "> dy (by LOTUS) 


10 a 


m + n + 
10 8 


m + n + 

To find the covariance function, we write 


T [y m+n+1 ]\. 


j ^(1.05) m+ " +1 — (1.04) m+ ” +1 j, for all m, n e {0, 1,2, --}. 
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C\{>n, n) = R x {m, n) - E[XJE[X n ] 

iO 8 r , ,1 

= - (1.05)'" + " + - (1.04) m+,,+ 

m + n + 1 L J 

101° 

- (m + \)(n + 1) [t 1 - 05 ^ 1 ~ ('•04)" l+1 ] [(1.05)” +1 - (1.04)" +1 ]. 

For { X(t ), t E [0, oo) } given in Example 10.2 . we have 

R£t x ,t 2 ) = E[X{t l )X{t 2 )\ 

= E[{A+Bt x ){A+Bt 2 )] 

= E[A 2 ] + E[AB](t x + t 2 ) + E[B 2 ]t x t 2 

= 2 + E[A\E\B](t x + t 2 ) + 2t x t 2 (since A and B are independent) 
= 2 + t x + t 2 + 2t x t 2 , for all t x , t 2 E [0, oo). 

Finally, to find the covariance function forX(f), we can write 

Cjfc 1’ ^ 2 ) = ^ 2 ) — ^[^(*i)]^W/2)] 

= 2 + t x + t 2 + 2r x t 2 — (1 + fj)(l + ^ 2 ) 

= 1 + fjf 2 , for a 11 ^2 ^ [0> °°)- 


<— previous 
next —> 
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